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ACTIVITY MONITORING 



This invention was made with government support under Grant Number 
1R41 AG02275 1-01 awarded by the National Institute on Aging. The government 
5 has certain rights in the invention. 

Background of the Invention 



In the field of remote health monitoring, systems have been developed to 
10 enable an individual to contact medical professionals from their dwelling regarding 
a medical emergency. For example, in various systems, an individual is equipped 
with an emergency call button that initiates a call or signal to an emergency call 
center. The concept of such a system is that if an individual has a health related 
problem, they can press the emergency call button and emergency medical 
15 providers will respond to assist them. However, in some cases, the individual is 

unable to press the emergency call button, such as when an individual has fallen and 
cannot reach the button or is rendered unconscious. 



More complex systems have also been designed to monitor medication 
20 compliance or check health characteristics of an individual, such as heart rate, body 
temperature, blood chemistry, blood pressure, respiration, and the like. In these 
systems, the individual typically has to provide data periodically, such as by 
telephoning a monitoring center to provide health information to the center or by 
checking onto a web site or other data collection system. For example, blood 
25 chemistry monitoring systems have been devised where an individual takes a 
sample of their blood, performs tests on the blood, and provides the results to 
medical professionals via a telephone line. The blood chemistry information is then 
reviewed by a medical professional in order to monitor the health of the individual. 

30 Neither of the above systems has the capability to automatically detect if 

someone has become incapacitated and requires assistance. There are numerous 
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For example, in various embodiments, a monitoring system can monitor the 
activities within a dwelling and can provide automated alerting to a number of third 
parties selected by the individual that can render assistance. Some embodiments 
5 can incorporate an emergency calling feature with an automated detection feature to 
detect if an individual has become incapacitated and to initiate a call to emergency 
personnel. Embodiments include systems to monitor the activity of an individual 
within a dwelling, such as a house, condominium, townhouse, or apartment. 

10 Embodiments of the invention include a number of sensors that are 

connected to a variety of items within the dwelling to indicate the activity of the 
individual. For example, sensors can be connected to the user's bed to indicate that 
a user is lying on the bed. Sensors can also be used on drawers and cupboards to 
indicate when the individual opens a drawer or the door to a cupboard. Many other 

15 types and uses for the sensors are described in more detail below. Various 

embodiments of the invention are designed to be transparent to the occupant of the 
dwelling and, therefore, such a system can monitor the daily routine of the occupant 
without the occupant having to interact with the system, such as by logging onto 
websites, entering health data, and the like. 

20 

Additionally, by using the information from the sensors, the system can 
identify the activity of the individual being monitored. The system can also track 
user behavior over time and can create expected amounts of activity and types of 
activity during certain periods of time. For example, in various embodiments of the 
25 system, the system can monitor sensors that indicate that the individual is eating, 
such as by tracking activations of sensors in the kitchen and the dining room. If 
tracked over a number of days, weeks, months, or even years, this information can 
be analyzed to identify a behavior routine. 

30 The information can be analyzed to identify if there is a usual pattern of 

activity or number of sensor activations that are indicative of the individual doing 
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accounts of such individuals that have been in distress for periods of hours or days 
after they have fallen or become ill and have not been able to summon help, 
especially with respect to elderly individuals living alone. 

5 Brief Description of the Drawings 

Figure 1 illustrates an activity monitoring system embodiment. 

Figure 2A illustrates a monitoring device embodiment. 

Figure 2B illustrates another monitoring device embodiment. 
10 Figure 3 A illustrates an embodiment for monitoring morning activity. 

Figure 3B illustrates an embodiment for monitoring afternoon activity. 

Figure 3C illustrates an embodiment for monitoring evening activity. 

Figure 3D illustrates an embodiment for monitoring nighttime activity. 

Figure 4 illustrates an embodiment for monitoring daily activity. 
1 5 Figure 5 A illustrates examples of sensor counts that can be used in the 

various embodiments. 

Figure 5B illustrates examples of sensor counts that can be used in the 
various embodiments. 

Figure 6 illustrates an embodiment of a calling hierarchy. 
20 Figure 7 illustrates a method for monitoring activity. 

Figure 8 illustrates another method for monitoring activity. 

Figure 9 illustrates another method for monitoring activity. 

Detailed Description of the Invention 

25 

Embodiments of the present invention can provide simple, cost effective, 
non-intrusive methods, devices, and systems for monitoring activity. Embodiments 
can provide automated detection of changes in activity within a dwelling and 
initiation of alerts to third parties to check on and/or assist the individual where 
30 assistance is needed, thereby avoiding prolonged periods of time before assistance is 
provided. 

2 
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an activity, such as eating. By tracking patterns of activity, the system can interpret 
when there is a statistical deviation in the behavior routine of the individual. A 
deviation in an analysis of a short period of time, such as hours, days, or weeks, 
may be an indicator, for example, that the individual is having a heath related 
5 problem. For instance, deviations can indicate that an individual has fallen or is 
incapacitated. 

The tracked pattern information can also be analyzed over a long period of 
time, such as months or years, to aid in the diagnosis of the emergence of a health 
10 related issue. For example, the data can indicate that an individual is sleeping more 
or less, eating more or less, or toileting more or less, each of which can be 
symptomatic of an emerging health condition. 

Embodiments of the invention can provide several types of alert triggers. 

1 5 For example, alert triggers can include an emergency switch/button, inactivity with 
the occupant believed to be home, and persistent (unusual) activity from one or 
more sensors (e.g., waving hand in front of a motion sensor after falling). In 
various embodiments, a confidence level can be created based upon the number of 
sensors that are indicating a change in the activity of the individual. For example, if 

20 one sensor is signaling abnormal behavior, but the other sensors in its group are 

recording normal behavior, the confidence level of the abnormal behavior could be 
assigned a low level. Whereas, when all sensors within a group are recording 
abnormal behavior, then the confidence level could be deemed to be high. 

25 With respect to cases such as inactivity with the occupant believed to be 

home, and persistent activity from one or more sensors, program instructions can 
monitor the activity of an individual to identify changes in a behavioral routine. For 
example, when many people go about their daily activities, the activation of sensors 
can occur in localized bursts (e.g., a burst of activity in the kitchen or a burst in the 

30 bathroom). In such cases, an activity can be considered as being started when a first 
count is received by the monitoring device. As stated above, a record can be kept of 
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the counts for that activity. If a count is received from a sensor in a different group, 
the current activity can be ended (with the end time being the time of the last count) 
and a new activity can be created with the start time being the currently received 
count. 

5 

Figure 1 illustrates an activity monitoring system embodiment. In the 
embodiment shown in Figure 1, the system includes a monitoring device 101, 
network access point 1 12, a number of sensors 114-1 through 1 14-N, and a number 
of third party contacts 116-1 through 1 16-M. The letters M and N have been chosen 
10 to indicate that embodiments can have various numbers of sensors/third parties. As 
used herein, M and N can be any number and M can be a number identical to or 
different from N. 

The monitoring device 101, as discussed in more detail below, includes 
15 program instructions to receive signals from the sensors 1 14-1 through 1 14-N that 
are generated by activation of a sensor, such as sensor 114-1. In various 
embodiments, signals are generated in a binary (or on/off) fashion, such that the 
sensor generates a signal when the object being sensed changes state. For example, 
with respect to a sensor on a door, one type of sensor that can be provided can 
20 operate such that when the door is closed, no signal is generated, but when the door 
is opened, a signal is generated. Similarly, when the door is closed again, another 
signal may be generated. Since the signals are either on or off, the signals are 
typically easy to track and the sensors are inexpensive. However, embodiments of 
the invention are not limited to the use of on/off type sensors. 

25 

The program instructions of the monitoring device 101 can also track signals 
related to a sensor, e.g. 114-1, and/or a group of sensors, such as sensors 114-1 
through 1 14-3. The tracking of the signals can be accomplished by counting the 
number of signals received from a sensor by the monitoring device 101 . The 
30 received signals are generally referred to herein as "counts". 
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As shown in the embodiment of Figure 1, the system includes one or more 
sensors. For example, in the embodiment of Figure 1 , five sensors are shown. The 
sensors can be of various types, for example, types of sensors include: sensors to 
indicate the opening and closing of a door or drawer; sensors to indicate the 
5 movement of objects such as shades or blinds; current and/or voltage sensors to 
monitor appliances, lights, wells, etc.; pressure or fluid flow sensors to indicate the 
turning on and off of water; temperature sensors to indicate that the furnace is on or 
off; force sensors such as strain gauge sensors to sense an individual walking over a 
pad, sitting in a chair, or lying in bed; motion sensors to sense the motion of objects 

1 0 within the dwelling; and alert switches/buttons to signal an emergency. The sensors 
can be either analog or digital type sensors and can include program instructions to 
transmit Boolean logic output to the monitoring device. In this way, the monitoring 
device can receive signals represented in formats such as on/off or 0/1 outputs. 
However, the embodiments of the invention are not limited to the above types of 

1 5 sensors or the above uses for the sensors. 

Those skilled in the art will understand that the various sensors can transmit 
their signals in any manner and that various sensors can transmit signals in different 
ways. For example sensors can transmit signals by radio frequency, infrared, 
20 acoustic, optical, and/or electrical signaling (e.g., power line carrier and hardwired), 
among other modes of transmission. 

Based upon the tracking of counts created by the activation of a sensor, 
program instructions can be provided to the monitoring device 101 to analyze the 

25 numbers of counts tracked by the monitoring device 101. For example, the analysis 
of the counts can be used to calculate expected numbers of counts for a particular 
sensor during a period of time. This analysis can also be done for a group of 
sensors, such as a group of sensors associated with an activity of daily living, for 
example. Activities of daily living can be characterized as any activity, of an 

30 individual, that can be sensed by the sensors of the various embodiments of the 
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invention. Other examples of groupings of sensors include sensors within a room or 
sensors grouped by function or type of sensor, among others. 

In various embodiments, analysis can compare the tracked counts to one or 
5 more thresholds. Thresholds can be used to indicate when a statistical change in the 
number of counts has deviated to a point where an alert should be initiated. The 
thresholds can be preset, set by the system, or input into the system during or after 
installation of the system into a dwelling. Those skilled in the art will understand 
that any triggering mechanism can be used to trigger an alert and that the 
10 embodiments of the present invention are not limited to the use of thresholds. 

The monitoring device 101, can also provide behavior routines that include a 
number of thresholds for making comparisons to the tracked counts. Thresholds 
can be used to trigger an alert in which a call to the individual and/or to one or more 
15 third parties 1 16-1 to 1 16-M, via a network access point 1 12, is initiated. The third 
parties 116-1 through 1 16-M include parties such as a neighbor, a relative, a doctor, 
an emergency contact, and/or monitoring system repair personnel, among others. 

A call can be initiated, for example, based upon the analysis including a 
20 comparison of the received counts to a threshold as will be described more fully 
below. The network access point 1 12 can provide a path for the monitoring device 
101 to communicate a message to a third party, such as third party 1 16-1 . For 
example, a Public Switched Telephone Network (PSTN) and a Mobile Switching 
Center (MSC) are two examples of network access points 1 12 that can be used with 
25 respect to embodiments of the invention. However, the embodiments of the 
invention are not so limited. 

Figure 2A illustrates a monitoring device embodiment. In the embodiment 
of Figure 2 A, the monitoring device 201 includes a display 202, a transceiver 204, 
30 an Input/Output (I/O) device 206, a processor 208, and memory 210. 

7 
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The display 202 can provide a number of functions. For example, the 
display 202 can be used to aid in the set-up of a monitoring system, such as the 
monitoring system shown in Figure 1 , by showing set-up instructions thereon. In 
this way, a person installing the monitoring system can follow the instructions and 
5 when finished can use the I/O device 206 to signal the monitoring system to move 
on to the next step of the set-up process. As shown in Figure 2A, an I/O device 206, 
such as a touch screen, speaker/microphone, and/or keypad, can be provided to 
allow the monitoring system to be configured by entering information therein. In 
some embodiments, the monitoring system can communicate with a set-up device 
10 (not shown) that can aid in setting up the monitoring system. Examples of set-up 
devices include personal computers and hand-held devices, such as personal digital 
assistants and the like, among others. The monitoring system can communicate 
with a set-up device in various manners, such as through the PSTN, a cellular 
telephone network, or an I/O connection to a device or network, among others. 

15 

Additionally, the display 202 and the I/O device 206 can be used together to 
provide various functions. For example, questions or blanks for data to be input can 
be presented on the display 202 and the I/O device 206 can be used to input 
information into the monitoring device 201 in response to the question shown on the 
20 display 202 or to fill in the blanks provided on the display 202. 

The processor 208 can operate on computer executable instructions as part 
of the control logic for controlling operations of the monitoring device 201. 
Computer executable instructions can be stored in the memory 210 and executed by 

25 the processor 208. Memory can also be used to store data used in embodiments of 
the invention, such as sensor activation counts, grouping of activities, trend 
information, and the like. Memory, as referred to herein, can include non- volatile 
and volatile memory such as read only memory (ROM) and random access memory 
(RAM), including flash memory and optical memory, among others. Those skilled 

30 in the art will understand that data stored in memory and signals from the sensors 
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can include security features, such as encryption, to maintain the privacy of the 
information in case of theft or other such circumstances. 

The monitoring device 201 can be a stand alone unit that is independent of 
5 other devices in the dwelling. The monitoring device 201 can also be incorporated 
or combined with various other household devices. For example, the monitoring 
device 201 can be combined with another household device, such that the combined 
unit provides additional functionalities such as a radio, a clock radio, an alarm 
clock, a telephone, or an answering machine, among others. In this way, the 
10 monitoring device component of the monitoring system is presented in a non- 
intrusive manner into the individual's life. 

Figure 2B illustrates another monitoring device embodiment. In the 
embodiment of Figure 2B, the monitoring device 200 generally includes a power 
1 5 supply 2 1 2, a micro controller unit 2 1 4, and a receiver 2 1 6. 

The power supply 212 provides power to the device 200. The power supply 
212 can be connected to a wired power source entering the dwelling and/or can be 
operable using batteries. The monitoring device 200 can include a power monitor 
20 236 that can monitor the amount of power available, available power sources, what 
power source is being used, and/or indicate that a power source has to be attended 
to, such as by indicating that the battery power is low or that batteries should be 
installed or changed. 

25 The micro controller unit (MCU) 214 can be used to control the functions of 

the monitoring device 200. For example, the MCU 214 can include program 
instructions such functions as handling received information from the sensors in the 
monitoring system and analyzing the count data, among others. A MCU can 
include RAM and/or ROM, a clock, an input/output, and a processor. 

30 
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As shown in Figure 2B, the monitoring device 200 can also include one or 
more types of memory (e.g., RAM 224, flash 226, non- volatile RAM 228, flash 
RAM 230, among others). This memory can be used to provide storage for various 
information, as described above with respect to memory 210 of Figure 2 A. 

5 

The monitoring device 200 also can include a receiver or transceiver for 
receiving signals from the various sensors of the monitoring system. For example, a 
RF receiver 216 connected to an antenna 218, as shown in Figure 2B, is one type of 
receiver. In the embodiment of Figure 2B, a display driver 220 has been provided 
10 to execute instructions regarding the functioning of a display such as an LCD or 
LED display resident on the monitoring device 200. The monitoring device 200, 
can also include a user input 222, such as a keypad and/or microphone to receiver. 

A speaker 240, an audio amp 238, and an audio switch 242 can also be 
1 5 included in the monitoring device 200. The speaker 240 is provided, for example, 
to provide an alert to the individual, among other functions. The audio switch 242 
can be used when the monitoring device 200 initiates an audio alert either to an 
individual (e.g., through speaker 240) or to a third party (e.g., via the telephone 
line). 

20 

The monitoring device 200 can also include a coder-decoder 232 and 
transformer driver 234. The coder-decoder 232 can be a dual tone multi-frequency 
(DTMF) coder-decoder, such as that shown in Figure 2B. The coder-decoder 232 
converts analog signals to digital code and vice versa. This enables the monitoring 
25 device 200 to, for example, store telephone numbers in memory as digital code and 
change the code into audible telephone dialing sounds to dial the telephone number. 

The transformer driver 234 can be used to feed audio output to a telephone 
line. For example, a message can be recorded, stored in memory, and when an alert 
30 is initiated, sent through the transformer driver 234 to the telephone line. The 
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transformer driver can also be used to adjust the volume and/or sound quality of a 
message. 

Figures 3A-3D illustrate a method of monitoring activity. Figure 3A 
5 illustrates activity during a period classified as the morning. Figure 3B illustrates 
activity during a period classified as the afternoon. Figure 3C illustrates activity 
during a period classified as the evening. Figure 3D illustrates activity during a 
period classified as nighttime. In the embodiment shown in Figures 3 A-3D, each 
period encompasses 6 hours of the day. However, the invention is not so limited. 

10 

Figure 3 A illustrates an embodiment for monitoring morning activity. In 
Figure 3 A, the activations of sensors in each room of the dwelling have been 
tracked and are shown. In the embodiment shown in Figures 3 A-3D, the counts and 
threshold amounts have been tracked according to each group of sensors within a 
1 5 particular room and a total number of counts and total threshold have been 
computed. In this way, this data can be used to trigger alerts based upon the 
statistical change in counts of the total period of time or can be used to trigger an 
alert based upon the statistical change of one or more of the groups of sensors. 

20 In various embodiments, a number of low and/or high thresholds can be 

used to trigger the initiation of an alert. In the embodiment shown in Figure 3 A, a 
single low threshold is used. A low threshold can be used to identify activity levels 
that are below a threshold of normal levels. Low levels can indicate, for example, 
that an individual has become immobilized or incapacitated. Conversely, high 

25 thresholds can be used to identify activity levels that are above a threshold of 

normal levels. High levels can indicate that an individual is using the sensor to try 
to signal that they are in need of assistance, for example, by repeatedly opening and 
closing a door on a cabinet. In the embodiment shown in Figure 3 A, the counts of 
each room for the morning period are all greater than the threshold amount. Since a 

30 low threshold is used, an alert will not be triggered. 



11 



Docket Number: 1 1 5.00 1 000 1 

Program instructions within a monitoring device can be used to analyze the 
data to determine when to trigger an alert. For example, the program instructions 
can analyze a number of counts from a room, e.g., bedroom, by comparing the 
number of counts that were signaled by the sensors within the bedroom to an 
5 expected threshold for activity. It is understood, however, that the sensors can be 
grouped into groups that are smaller than all of the sensors in a room and that 
sensors can be tracked independently from the other sensors. 

In the example shown in Figure 3 A, the bedroom recorded five counts from 
10 sensors in the bedroom, with the threshold set at four. The number of sensor counts 
is greater than the threshold amount and, therefore, in the embodiment of Figure 3 A, 
the activity shown is considered normal activity. Alternatively, if the number of 
sensor counts is lower than the threshold, it can be interpreted to indicate abnormal 
activity. 

15 

Since there can be many reasons for abnormal activity, program instructions 
can use information from other sensors to provide additional certainty before the 
monitoring device initiates alerts and calls to third parties. For example, the 
individual has an appointment in the morning and rushes to get ready. In this 
20 instance, perhaps only three counts are recorded in the bedroom and only three 
counts are sensed in the bathroom. In this case, program instructions will identify 
that the numbers of counts for those rooms are less than the thresholds for their 
respective rooms. 

25 The program instructions can be designed to trigger an alert based upon a 

statistical change that is below the threshold in the case of one or both rooms, or the 
program instructions can use additional data to further identify whether an alert 
should be triggered. Various types of additional information can be used to provide 
additional certainty to the determination of whether an alert should be initiated. For 

30 example, other information that can be taken into account can be the count total 
from other rooms, the total count total for the period, whether the individual is still 
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within the dwelling, number of counts in previous time periods, or waiting for the 
next time period to receive more information and using that information to further 
analyze whether an alert should be triggered, among others. 

5 For example, Figure 3B illustrates an embodiment for monitoring afternoon 

activity. If the activity in the afternoon period has returned to above threshold 
levels, then there is no immediate need for an alert. However, in some 
embodiments, the statistical changes that fell below the threshold can be recorded 
and used for analysis of long term changes in activity. 

10 

This information can also be used to adapt the expected levels of sensor 
counts. This allows the monitoring system to learn the routine of the individual and 
adapt its thresholds to better mirror the routine of the particular individual the 
system is monitoring. For example, if the individual always has a meeting during 
1 5 the week and rushes to get ready resulting in counts that are below the threshold, 
then the program instructions in the system can review the recorded statistical 
changes to identify if there is a better fit threshold than the threshold that is being 
applied. 

20 In order for the program instructions to be able to adapt, a probabilistic 

approach to problem solving can be employed, e.g. through use of Bayesian or other 
such decision theories. For example, starting with the general behaviors within an 
individual's routine, such as things like eating, sleeping, toileting, etc., a 
compositional model of behavior can be created. 

25 

A behavior template that models the behavior of the individual can be 
created for each general behavior. The behavior template can be parameterized so 
that individual variances can be accommodated and adjusted after installation. For 
example, the initial time periods for expected behaviors will be largely undefined at 
30 installation, but as data about the counts from the sensors is acquired and analyzed, 
and conclusions reached by the program instructions, the time periods (and other 
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parameters) will be gradually adjusted to more accurately represent the routine of 
the individual. In addition to understanding generally when an event, such as 
waking, will take place, the sensors that are activated can provide low level detail 
about what the individual is actually doing. For example, when a number of counts 
5 are received from sensors in the kitchen, it can be assumed that the individual is 
preparing to eat. 

Additionally, the particular sensors can each be individually identifiable in 
various embodiments which can allow for a level of detail such as: the individual 

10 turned on the light, went to the cupboard where the glasses are kept, then to the 
cupboard with the plates, then to the drawer with the silverware, then to the 
refrigerator, and this procedure took 3.25 minutes. The light was then turned off 15 
minutes later. This information can be helpful in many ways. For example, the 
time and distance to achieve the same tasks, when monitored over a long period of 

1 5 time, can help to indicate whether the individual's mobility is beginning to be 
impaired, based on the time to achieve the tasks slowing over time. 

Recorded low level details, such as appliance usage, can be composed into 
more complex and, consequently, more informative behaviors. The low level 
20 details can contain information including the start and stop time of the behavior and 
other data relevant to the behavior (e.g., location). The low level details can be used 
with Boolean decision theory (e.g., true/false or yes/no) such that it can be 
determined whether or not the behavior was observed. 

25 Certain sensor behaviors can also indicate behaviors that are better 

indicators of an individual having a health problem. For example, if sensor activity 
indicates that the shower has been running for a prolonged period, it may be an 
indication that the individual is unable to turn off the shower and therefore, outside 
assistance may be necessary. Such functionality can be provided by the program 

30 instructions of the monitoring device. 
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Additionally, since most people do not do exactly the same thing everyday, a 
standard deviation can be used with the one or more thresholds. In this way, the 
thresholds are not discrete lines that are crossed, but rather there is a range of 
acceptable counts for each sensor and/or group of sensors. 

5 

Figures 3C and 3D illustrate embodiments for monitoring activity during an 
evening and a night time period. These Figures illustrate that thresholds can be 
different for each time period, since people are typically not in the same place all 
day and typically do different things at different times of day. In various 

10 embodiments, the monitoring device can be designed to have default thresholds 
such that when the monitoring system is initially set up, the alert functionality is 
functional. In various embodiments as discussed above, the program instructions of 
the monitoring device can track the received counts and can learn from the patterns 
within the tracked count data to learn about the behavior routine of the particular 

1 5 individual being monitored and can adjust the thresholds based on the behavior 
routine. 

The system can also include program instructions to provide a self- 
diagnostic functionality to assess whether the system is functioning properly, 

20 optimally, and/or the like. For example, the monitoring system can ascertain 

whether a sensor has been moved to a different group without being reassigned. For 
example, if a sensor from the kitchen has been moved to the bedroom, when the 
individual is in the bedroom, movement may be indicated as occurring in both the 
bedroom (i.e., by the other sensors in the room) and in the kitchen (i.e., by the 

25 sensor that has been moved but not reassigned). Through use of the self-diagnostic 
functionality, the incorrect positioning of sensors can be identified and a request to 
reposition the sensor can be made to the individual or to system repair personnel. 

In various embodiments, program instructions within a monitoring device 
30 can also use a self-diagnostic functionality to analyze the sensor data to determine 
when the monitoring device, the monitoring system, or a sensor is malfunctioning or 

15 
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is not operational. For example, the program instructions can analyze a number of 
counts from a sensor within a group, such as a room, and can identify a deviation 
from a normal routine based on the change in counts that were received from the 
sensor. If an abnormally low or high number of counts, for example, are received, 
5 the monitoring system can check other sensors within the room to see if they are 
signaling activity, and can identify if the activity of the other sensors is consistent 
with the behavior routine. 

If the other sensors are signaling normal behavior, the monitoring system 
10 can continue to monitor the sensor, signaling abnormal behavior, to further confirm 
that it is malfunctioning or inoperative, or can initiate an alert to the individual 
and/or monitoring system repair personnel to check the sensor. Those skilled in the 
art will understand that in various embodiments, the monitoring device can diagnose 
problems within the monitoring system in various manners and can initiate alerts to 
15 the individual and/or repair personnel based upon the diagnosis. 

Figure 4 illustrates another embodiment for monitoring daily activity. 
Figure 4 shows another organization of the sensors and time periods used by the 
monitoring system. In this embodiment, the time periods are waking, breakfast, 
20 morning activity, lunch, afternoon activity, dinner, and preparation for bed. In this 
embodiment, the sensors are also grouped by the room that they are positioned, 
however, in this embodiment, since the activities can take place in more than one 
room a number of groups of sensors (that have been grouped by room) are 
combined to create the number of sensor counts for each period. 

25 

Figures 5A and 5B illustrate another method of organizing the sensors and 
time periods for monitoring activity. Figure 5 A illustrates an example of a log of 
normal counts grouped by time and by an activity of daily living. In this log, the 
individual is activating sensors in a normal routine. 

30 
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Figure 5B illustrates an example of a log of abnormal counts grouped by 
time and by an activity of daily living. The abnormality can be identified by 
comparing the log of Figure 5 A with the log of Figure 5B. 

5 When comparing the two logs it becomes evident that the individual's 

activity has dropped off to zero for the periods of 4PM-8PM and 8PM- 12 AM. The 
program instructions will interpret this statistical change in the counts as a potential 
situation in which an alert should be issued. 

10 In some embodiments, the individual can wear a sensor to indicate that they 

are in an area within and/or near the dwelling. Program instructions can check to 
see if the sensor is located within and/or near to the dwelling. (In some 
embodiments, the sensor can be detected outside the dwelling, but within a certain 
range of the transceiver, e.g., transceiver 204). 

15 

Locating the wearable sensor can be accomplished in various manners, such 
as by initiating a ping signal from the transceiver to the wearable sensor. In such a 
case, the wearable sensor can also include a transceiver and can receive the ping 
signal and can respond. The transmission of the ping signal can be by any means, 

20 such as via a radio frequency, and the like. In some embodiments, the sensor can be 
constructed to periodically check-in with the monitoring device, such as by sending 
a ping signal to the monitoring device via radio frequency or other such manner. In 
such embodiments, the sensor can be provided with energy saving program 
instructions that allow the sensor to be in "sleep mode," where power usage is 

25 reduced, and then to "awaken" periodically to send a ping signal to the monitoring 
device. Once the signal is sent, the sensor can then return to "sleep mode." 

If a response to the ping signal is received by the monitoring device, then the 
program instructions can interpret that to mean that the individual is within the 
30 signal range of the monitoring device. If a deviation in a behavior routine has been 
identified and a ping response has been received, program instructions can initiate 
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an alert to the individual as has been discussed above. If no response is obtained 
from the individual, then the program instructions can determine which third party 
to contact. Those skilled in the art will understand that other sensors can be used in 
combination with, or instead of, a sensor worn by the individual to determine 
5 whether the individual is within the dwelling. Examples of other sensors include, 
motion sensors, sensors on the interior/exterior/garage doors, and the like. 

If the occupant is determined to be away, that decision is recorded along 
with the evidence supporting the determination. If the occupant is believed to be 
10 home, then previously recorded activity can be analyzed to determine the potential 
activity period. 

To determine this period, activities for a number of previous days can be 
retrieved from memory. The next potential activity period can be selected based on 
15 proximity (in time) to the current time (e.g., if it is currently 7AM, those activities 
nearest to 7AM that happened on previous days will be reviewed first), the 
frequency with which any activity was observed during that period can be used as 
the threshold for the current period. 



20 In some embodiments, if trend analysis of the recorded activity indicates 

that, for example, each day of the week has a distinct pattern, then the system can 
analyze data from the same day of the week to identify a potential activity period. 
The decision to trigger an alert is based on two confidence thresholds, for example, 
that the occupant is home and that the inactivity is anomalous provides a 

25 mechanism to reduce the number of false alerts that could potentially be generated. 

Additionally, in various embodiments, an emergency switch/button can be 
used to allow the individual to initiate a call from the third party contact list. For 
example, the monitoring system can include program instructions to initiate a call to 
30 the emergency contact on the call hierarchy when a signal is received from the 
emergency switch/button. 
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Figure 6 illustrates an embodiment of a calling hierarchy. In the 
embodiment of Figure 6, the call hierarchy has five contacts thereon. The first 
contact is to the individual whose activity is being monitored. This contact can be 
5 accomplished in any manner, such as by telephone, by displaying a message on the 
display of the monitoring device, e.g., display 202, by an audible alert that can be 
turned off through use of the I/O device 206, among others. For example, an 
audible alert can be a recorded voice that asks the individual to respond to a 
question, such as, "Are you alright?" The recorded voice can be personalized to 
10 have the individual's voice or the voice of a family member ask the question. 

If a response is not received within a period of time, the monitoring device, 
e.g., 101 can initiate a call, such as to the second party on the hierarchical list, in the 
case of Figure 6, a neighbor. It is understood that the monitoring system can be 
1 5 designed such that it can skip parties on the hierarchical list under certain 
circumstances. For example, if the statistical change in the data counts is 
particularly large, then program instructions can bypass one or more third parties. 

Additionally, in various embodiments, based on the type of statistical 
20 change, a specific party on the list can be contacted. For example, if the statistical 
change indicates a drastic drop in eating, program instructions within the monitoring 
system may analyze the situation through use of logic and decide to initiate a call to 
the doctor without a call to the neighbor and a family member. The decision by the 
monitoring system can, for example, be because the individual is indicating a loss of 
25 appetite, but is not indicating that the individual has been incapacitated, so there is 
no need for the neighbor or a family member to check on the individual. However, 
the doctor may be interested in this information or may be able to provide some 
assistance in getting the individual to begin eating regularly again. 

30 The embodiment of Figure 6, also illustrates that the information provided to 

the third parties can be different such that the third party receives the right amount 
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of information for their needs. For example, since the neighbor is to be asked to 
check on the individual, the name of the individual and their telephone number are 
provided along with the request to check on the individual. It is presumed that the 
neighbor knows where the individual lives, so the address information has not been 

5 given. However, the invention is not so limited. The relative receives the same 
information as the neighbor except the relative also receives the address, since they 
may have to drive to check on the individual. The doctor and emergency contact 
receive information regarding the condition that caused the monitoring system to 
initiate the third party calls, since they may find that information helpful in forming 

10 a diagnosis of a health issue. Other information can also be provided, such as 
driving directions, a list of contacts that have been attempted by the monitoring 
system, and/or medical history information about the individual, among others. 

In various embodiments, the monitoring system includes a transceiver and 
15 program instructions to receive a reply from a third party contact that has been 
contacted. For example, the monitoring system can initiate an alert to a neighbor 
and the neighbor can call back and reply that they are coming by to check on the 
individual. 

20 The monitoring system can be programmed to receive the replies in various 

forms. For example, program instructions can include automated voice response 
technology to enable the neighbor to speak to the monitoring device and the device 
can understand the spoken information. In other embodiments, the program 
instructions can be in the form push button responses from a telephone. However, 

25 the invention is not so limited. 

Figures 7-9 illustrate various method embodiments for monitoring activity. 
Unless explicitly stated, the method embodiments described herein are not 
constrained to a particular order or sequence. Additionally, some of the described 
30 method embodiments and elements thereof can occur or be performed at the same 
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point in time. Method embodiments can be performed by computer executable 
instructions on software and/or firmware. 



The embodiment of Figure 7 includes monitoring a sensor activated by an 
5 individual at block 710. At block 720 the method includes recording activation of 
the sensor. The method also includes determining a behavior routine of the 
individual based on recorded activations of the sensor at block 730. At block 740, 
the method includes analyzing the recorded sensor activations to determine a 
behavior routine. Analyzing the recorded sensor activations to determine a behavior 

10 routine can include using a pattern recognition algorithm. Using a pattern 
recognition algorithm can include an algorithm based on a Bayesian decision 
theory, among others. The method also includes identifying a change in the 
behavior routine based on the analysis of the recorded sensor activations at block 
750. Identifying a change in the at least one behavior can include comparing 

15 activations of a group of sensors within a class to a threshold. 

The method can also include initiating contact to a third party. In various 
embodiments, initiating contact to a third party can include initiating contact with a 
third party on a hierarchical list of third party contacts. Initiating contact with a 
20 third party on a hierarchical list can include selecting a third party based on the level 
of change in the behavior routine. In various embodiments, the contact can include 
automated contact. 



Methods can also include grouping sensors within particular classes of daily 
25 activities. Methods can include providing a sensor with a level of priority. In such 
embodiments, identifying a change in the behavior routine can include weighting 
sensor activations differently based upon the sensor's level of priority. 

The embodiment of Figure 8 includes recording data counts from sensors 
30 activated by an individual during a time period at block 810. Recording data counts 
from a sensor can include recording data counts from a sensor with Boolean logic. 
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At block 820, the method includes identifying statistical changes in the data 
counts relative to expected data counts during the time period. Identifying 
statistical changes in the data counts can include developing an expected count for 
5 the activity of daily living over the time period and initiating automated contact to a 
third party on the hierarchical third party list when the recorded counts are 
statistically less than the expected count for the activity of daily living over the time 
period. 

10 The method also includes initiating automated contact to a third party on a 

hierarchical third party list identified by the individual when a statistical change 
exceeds a statistical threshold value at block 830. Initiating automated contact to a 
third party on a hierarchical third party list can include analyzing the data counts in 
a group for a statistical change that exceeds the statistical threshold value. Initiating 

1 5 automated contact to a third party on a hierarchical third party list can include 

identifying at least two statistical based changes that exceed the statistical threshold 
value. Initiating automated contact to a third party on a hierarchical third party list 
includes prompting the individual to confirm that automated contact to the third 
party should be made. 

20 

In various embodiments, methods can also include associating the data count 
with an activity of daily living and placing the data counts into groups based on 
activities of daily living. Methods can also include setting the time period to a value 
of one (1) hour or greater, however, the invention is not so limited. Methods can 
25 also include diagnosing an operational condition of a sensor that detected a reduced 
number of data counts. 



The embodiment of Figure 9 includes sensing data counts associated with an 
activity of daily living for an individual at block 910. At block 920, the method 
30 includes determining a statistical change in the data counts relative to expected data 
counts for the activity of daily living. 
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The method also includes identifying when the statistical change in the data 
counts relative expected data counts exceed a statistical threshold value at block 
930. At block 940, the method includes selecting a third party on a hierarchical 
5 third party list prepared by the individual based on the activity of daily living for 
which the statistical change in the data counts relative expected data counts exceed 
the statistical threshold value. 

The method includes initiating automated contact to the third party on the 
10 hierarchical third party list when the statistical based change exceeds the statistical 
threshold value at block 950. Initiating automated contact to a third party on a 
hierarchical third party list can also include prompting the individual to confirm that 
automated contact to the third party should be made. 

15 In various embodiments, methods can also include adjusting the expected 

data counts of an activity of daily living based upon the statistical change in the data 
counts for the activity of daily living. Methods can also include providing a 
predetermined amount of information about the individual and the activity of daily 
living to the third party on the hierarchical third party list. Methods can also include 

20 placing the third parties on the hierarchical third party list into multiple tiers of 
contacts. In such embodiments, selecting the third party on the hierarchical third 
party list can also include selecting a second third party in a next tier of the multiple 
tiers. 

25 Methods can also include requesting automated contact to the third party on 

the hierarchical third party list by the individual and initiating the automated contact 
to the third party on the hierarchical third party list at the request of the individual. 
In various embodiments, the method can also include identifying a sensor that is not 
transmitting data counts based on the statistical change in the data counts of the 

30 sensor relative to expected data counts for the sensor. Methods can also include 
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adjusting the expected data counts for the sensor based upon the statistical change in 
the data counts. 

Although specific embodiments have been illustrated and described herein, 
5 those of ordinary skill in the art will appreciate that an arrangement calculated to 
achieve the same techniques can be substituted for the specific embodiments shown. 
As one of ordinary skill in the art will appreciate upon reading this disclosure, 
various embodiments of the invention can be performed in one or more devices, 
device types, and system environments including networked environments. 

10 

Combination of the above embodiments, and other embodiments not 
specifically described herein will be apparent to those of skill in the art upon 
reviewing the above description. The scope of the various embodiments of the 
invention includes other applications in which the above structures and methods can 
15 be used. Therefore, the scope of various embodiments of the invention should be 
determined with reference to the appended claims, along with the full range of 
equivalents to which such claims are entitled. 

In the foregoing Detailed Description, various features are grouped together 
20 in a single embodiment for the purpose of streamlining the disclosure. This method 
of disclosure is not to be interpreted as reflecting an intention that the embodiments 
of the invention require more features than are expressly recited in each claim. 
Rather, as the following claims reflect, inventive subject matter lies in less than all 
features of a single disclosed embodiment. Thus, the following claims are hereby 
25 incorporated into the Detailed Description, with each claim standing on its own as a 
separate embodiment. 
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